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Abstract — We study quantization of log-likelihood ratios (LLR) 
in bit-interleaved coded modulation (BICM) systems in terms 
of an equivalent discrete channel. We propose to design the 
quantizer such that the quantizer outputs become equiprobable. 
We investigate semi-analytically and numerically the ergodic and 
outage capacity over single- and multiple-antenna channels for 
different quantizers. Finally, we show bit error rate simulations 
for BICM systems with LLR quantization using a rate 1/2 low- 
density parity-check code. 

I. Introduction 

Bit-interleaved coded modulation (BICM) is an attractive 
' scheme for wireless communications where a block of infor- 
mation bits is mapped to transmit symbols via a channel en- 
\ coder and a symbol mapper separated by a code bit interleaver 
. [1]. At the receiver side, a demodulator (demapper, detector) 
' calculates log-likelihood ratios (LLR) for the code bits, which 

are de-interleaved and passed to the channel decoder 
' Theoretically, one real-valued LLR per code bit needs to be 
computed and stored by the receiver. Clearly, practical digital 
implementations can only use finite word-length approxima- 
1 tions of real numbers, which motivates the study of LLR 
■ quantization. We note that LLR quantization is also relevant 
. for wireless (relay) networks that perform distributed turbo 
] and network coding by exchanging soft information between 
r different nodes. Optimal LLR quantization maximizing infor- 
' mation rate for the special case of BPSK modulation over an 
AWGN channel was considered in [2]. However, an extension 
of this approach to other channels and modulations appears 
infeasible. Thus, we consider a different quantizer design 
in this paper which allows for simple implementation while 
only slightly degrading information rate. More specifically, our 
contributions are as follows: 

• We propose to quantize the LLRs such that the quantizer 
outputs become equiprobable and provide appropriate 
reliability information to the channel decoder. 

• We investigate the impact of the proposed LLR quantiza- 
tion on ergodic and outage rate, using a semi-analytical 
approach for single-input single-output (SISO) systems 
with BPSK and Monte-Carlo simulations otherwise. 

• We develop a method for designing and implementing 
the proposed quantizer during data transmission. 

• We provide bit error rate (BER) simulations for BICM 
systems with LLR quantization using low-density parity- 
check (LDPC) codes. 



The paper is organized as follows. Section II presents 
the system model and Section III discusses the proposed 
LLR quantization based on an equivalent discrete channel. In 
Sections IV and V, we study the system capacity of SISO- 
and MIMO-BICM systems, respectively. The estimation of 
the quantizer parameters is addressed in Section VI and BER 
results are provided in Section VII. 

II. System Model 

We consider a MIMO-BICM system with A/t transmit 
antennas and Mr receive antennas (SISO-BICM can be viewed 
as special case with Mj^M-g,^!). A block diagram is shown 
in Fig. \. A sequence of information bits h\n'] is encoded using 
an error-correcting code, passed through a bitwise interleaver 
n and then scrambled by a pseudo-random sequence pi[n]. 
The uniformly distributed interleaved and scrambled code bits 
are demultiplexed into Mj antenna streams ("layers"). In each 
layer, groups of m code bits are mapped to (complex) data 
symbols Xk\n] ^ A, k = 1,...,7\/t; here, A denotes the 
symbol alphabet of size |^| ~ 2"\ The transmit vector at 
symbol time n is given by x.[n] = {xi[n] . . . x^jin])'^ and 
carries Rq — mMj interleaved code bits ci[n], 1 = 1, . . . , R^. 

Assuming flat fading, the length- Mr receive vector equals 



y[n] = H[?i]x[n] + yv[n]. 



(1) 



Here, H[n] is the Mr x Mj MIMO channel matrix and w[n] ~ 
CJ\f{0, (T^I) denotes the complex Gaussian noise vector. In the 
following, we will omit the time index n to simplify notation. 

At the receiver, the max-log demodulator calculates LLRs 
for the code bits c; according to [3] 



min 1 1 V — Hx I 
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(2) 



Here, Xj' denotes the set of transmit vectors for which c/ = 
b. These LLRs (or approximate/quantized versions thereof) 
are de-scrambled by the sequence pi[n\ = l~2pi[n], de- 
interleaved and used by the channel decoder to obtain bit 
estimates b[n]. The symmetric noise distribution and the use 
of the scrambler yield the symmetries /a(0 = ./a(~0 
./a|c(^|c= 1) = /a|c(— C|c = 0) for the (un)conditional LLR 
distribution. Hence, knowledge of /a|c(C|c = 1) is sufficient 
for characterizing A. 
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Fig. 1. Block diagram of a MIMO-BICM system. 



III. LLR Quantization 

The LLRs in (2) can attain any real value. We next study 
how to quantize these LLRs. While in practice the demodulator 
will directly deliver quantized LLRs, the efficient calculation 
of quantized LLRs is out of the scope of this paper 

We consider a g-bit quantizer characterized by K = 2' bins 
= [ik-1, ik], k = 1, . . . ,K. We use the convention io = 
— oo, iK — oo and assume symmetric bins (this is motivated 
by the symmetry of the LLR distributions), with boundaries ik 
sorted in ascending order The quantizer Q( ) maps the LLR 
A; to a discrete LLR di according to 

di = Q{Ki) = \k ifAiGXfc. 

Here, Afc G Ik is the fcth quantization level. 

In the following, we consider the equivalent discrete chan- 
nel with binary input c e {0, 1} and A'-ary output d E 
{Ai, . . . , Aa'}- Here, c and d are obtained by randomly picking 
a bit position / = 1, . . . , i?o according to a uniform distribu- 
tion. This models a situation where the outer channel code 
is "blind" to the bit positions within the symbol labels. The 
crossover probabilities p^k = Pr{d = Afc|c = 6} = Pr{A G 
Ifc|c = b} of this channel are given by 



Pbk 



where /a|c(^|^) is the conditional probability density function 
(pdf) of the LLR A given that c ^ b (averaged with respect 
to bit position 0- Note that Pr{d = Afc} = Pr{A € Ik} = 
■^{pok +Pik)- The mutual information (capacity) / = I{c;d) 
of this discrete channel is given by [4] 
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(3) 



If the LLR distribution /a|c(CI^) ™d hence the transition 
probabilities p^k are averaged with respect to the statistics of 
the physical channel H (reflecting fast fading), the quantity 
/ describes the ergodic rate achievable over the equivalent 
channel (cf. [5]). Otherwise (quasi-static fading), the transition 
probabilities ptk, and thus the rate /, change with every 
realization of the channel matrix H. Here, the probability 



Pout(r) = Pr{/ <R}, 0<R<Rq 



(4) 



characterizes the rate (denoted R) versus outage trade-off [5]. 

Designing the quantizer to maximize the mutual information 
/(c; d) appears analytically infeasible in general (for BPSK 



and no fading the solution is given in [2]). Hence, we propose 
a different approach: since c — A — d is a Markov chain, the 
data processing inequality implies I(c ; d) < I{c ; A). In order 
for I(c:d) to be as close as possible to /(c;A) (for fixed 
K), our proposed quantizer maximizes the mutual information 
/(A; d). With H{-) denoting entropy, it foflows that /(A; d) = 
H{d) — H{d\A) and H{d\A) — because is a deterministic 
function of A. H{d) is maximized by a uniform distribution of 
d and therefore, the quantizer boundaries i^, k — 1, . . . , A'— 1, 
have to ensure that 
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Using the unconditional cumulative LLR distribution F\{X) = 
Pr{A < A} = i /^^ [fA\Mc - 0) + /A|,(e|c = 1)] dt the 
optimal boundaries can be obtained by finding the arguments 
for which F\{X) = k/K, i.e.. 



(6) 



We note that for the capacity in (3) only the bins (bound- 
aries) are relevant, i.e., the actual quantization levels Afc do 
not influence the achievable rate. However, these values are 
important in order to provide the channel decoder (e.g., a belief 
propagation decoder) with correct reliability information [6]. 
In view of the equivalent discrete channel, we hence propose 
to choose the quantization levels as corresponding LLRs 



X* , Pr{c= l|d = Afc} Plk 

= log -5-7 7^ TT = • 

Pr{c = d = Afc} pok 



(7) 



We finally note that A^ e I^ 



IV. SISO-BICM Systems with BPSK Modulation 

We next study in more detail the case of a SISO system 
{Ah = A/r = 1) with BPSK modulation (Rq = Ibpcu) in 
Rayleigh fading'. Here, the system model (1) becomes real- 
valued and simplifies to y = hx + w, with h ^ Af{0, 1), 
w - 7V(0, crV2), and .t = 2c - 1 G {-1, 1}. Then, the LLR 
A in (2) equals 



A = = -\h{hx + w). 



(8) 



'The results in this section also apply to the inphase and quadrature phase 
of SISO systems with Gray-labeled QPSK and to the two layers of BPSK- 
modulated 2x2 MIMO systems. 
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Fig. 2. Comparison of ergodic capacity for SISO-BICM with BPSK and 
different quantizer word-lengths. 
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Fig. 3. Outage probability for quasi-stationary fading for SISO-BICM with 
BPSK for rate ij=l/4bpcu and R = 3/4bpcu. 



A. Ergodic Capacity 

Conditioned on c ~ x = 
A = 4y z-^A z , where z = 



1, the LLR can be rewritten as 
h ^M{0,I) and 



A = 



1 

cr/2 



cr/2 





Using the eigenvalue decomposition A ~ USU^, with U 

orthogonal and S = diag{(Ti, cr2}, where (Ti_2 
we further obtain 



A = — z^Sz = — 



Here, z = U z ~ J\f{0,l) due to the orthogonality of U. 
Thus, A is a linear combination of two independent chi-square 
random variables with one degree of freedom. The distribution 
/a|c(C|c = 1) can thus be shown to be given by (cf. [7]) 



/Mc(e|c=l) = - cxp( - ^VT+^) Kom), 



(9) 



where A'o( ) denotes the modified Bessel function of the 
second kind and order 0. 

Using (9), one can determine the LLR distribution, the LLR 
quantization (cf. (6)), and the ergodic capacity of the equiva- 
lent channel. Numerical results for the rate in bits per channel 
use (bpcu) versus SNR achievable with our proposed LLR 
quantizers of different word-length q are shown in Fig. 2. As a 
reference, we also show the capacity of non-quantized max-log 
demodulation (labeled 'no quant'). Hard-output demodulation 
(i.e., 1-bit quantization) incurs a significant performance loss 
compared to non-quantized demodulation (more than 5dB 
at rate 1/2 bpcu). With 2-bit and 3-bit LLR quantization, 
performance remains within 1 dB of the non-quantized case up 
to rates of approximately 1/2 bpcu and 3/4 bpcu, respectively. 

B. Outage Capacity 

Additionally conditioning on the channel coefficient h, it 
follows straightforwardly that A|c ~ Af {x -f , 2'^) with 7 = 
/i^/tT^. This allows to calculate the transition probabilities of 
the equivalent channel as 

^,'^fc-l-(2fe-l)7^^ ^^ife- (26-1)7^ 
Pbk = Q 



The outage probability can thus be evaluated according to (4). 
Numerical results of Pout{r) versus SNR for quasi-stationary 
fading with rate R = 1/4 bpcu and with R ~ 3/4 bpcu are 
shown in Fig. 3. LLR quantization with more than 2 bits is 
required to offer performance gains at medium-to-high outage 
probability. At high SNR, the gap between the non-quantized 
case and all quantized demodulators {q ~ 1,2,3) is 2.5 dB 
and 1.5 dB for R~ 1/4 bpcu and i? = 3/4 bpcu, respectively. 
Here, g > 3 is required to close this gap and to reach outage 
probabilities close to the non-quantized case. 

V. MIMO Systems and Higher-Order Modulation 

In the following, we investigate LLR quantization for 
MIMO systems and higher-order constellations. Since in this 
case analytical expressions for the LLR distribution are hard 
to obtain in general, the remaining discussion is based exclu- 
sively on numerical results. For the capacity results in this 
section, we used empirical LLR distributions obtained from 
Monte-Carlo simulations to determine the bins Tk such that 
Pr{A S Tk} = 1/K (cf. (5)). In the remainder of the paper, 
we will consider a 2x2 MIMO system with Gray-labeled 16- 
QAM modulation (here, i?o = 8bpcu). 

A. Ergodic Capacity 

We evaluated the capacity in (3) under the assumption 
of ergodic spatio-temporally i.i.d. fast Rayleigh fading for 
various quantizer word-lengths q. To this end, we estimated 
the transition probabilities ptk by means of Monte-Carlo 
simulations after having determined the optimal bins based on 
10^ channel realizations. Fig. 4 shows the results obtained. It 
can be seen that the extreme case of 1-bit quantization yields 
a considerable performance loss in comparison to the non- 
quantized case (e.g., 3dB SNR loss at 4 bpcu). Increasing the 
number of quantization levels reduces this gap significantly (to 
0.5 dB and 0.1 dB for 2-bit and 3-bit quantization, respectively, 
at 4 bpcu). Even though at higher rates slightly increasing 
SNR gaps are observed, these results suggest that 3-bit LLR 
quantization is sufficient for practical purposes. 

In order to illustrate the impact of the LLR quantizer design 
on ergodic capacity, we consider the same 2x2 MIMO-BICM 
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Fig. 5. SNR required for a target rate of 2, 4, 6 bpcu vs. quantizer boundary 
is of a 2-bit LLR quantizer (2x2 MIMO-BICM system with Gray-labeled 
16-QAM). Boundaries 43 of proposed quantizer are marked by green dots. 



system with Gray-labeled 16-QAM modulation for various 2- 
bit (i.e., 4-level) LLR quantizers. Since symmetric quantization 
here amounts to ^2 = and ii — —i^, the boundary is 
sufficient to index all quantizers in this case. Fig. 5 plots 
the SNR required to achieve target rates of 2 bpcu, 4 bpcu 
and 8 bpcu versus 13, respectively. As a reference we also 
show the required SNR using a 2-bit quantizer with uniform 
distribution and the required SNR for 1-bit quantization (hard 
demodulation). It can be seen that for rates of 2 bpcu and 
4 bpcu the 2-bit quantizer with uniform distribution requires 
the same SNR as the 2-bit quantizer with optimal choice of 
^3 (this is the quantizer proposed in [2]). For rates of 6 bpcu 
the SNR loss of the 2-bit quantizer with uniform distribution 
is about 1 dB compared to the optimal quantizer 

B. Outage Capacity 

We next provide numerical results for the outage proba- 
bility in (4) for quasi-static fading. Fig. 6 shows the outage 
probability Pout{r) versus SNR for different quantizer word- 
lengths and i? = 2 bpcu and i? = 6 bpcu. From the asymptotic 
slopes of these curves it is seen that the diversity order 
equals 2 in all cases. For R = 2 bpcu and R = 6 bpcu, hard 
demodulation {q = 1) is respectively 4.8 dB and 1.8 dB away 
from the non-quantized case at high SNR. LLR quantization 
with 2 and 3 bits performs only slightly better at very low 



outage probability, but offer significant gains at medium-to- 
high outage probability. For R ~ 2 bpcu, the SNR loss of 
LLR quantization with 1, 2, and 3 bits at Pout = 10~^ equals 
4dB, 1.4dB, and 0.4 dB, respectively. 

VI. Estimation of Quantization Parameters 

The computation of the quantization boundaries jjl and 
quantization levels A^. according to (6) and (7), respectively, 
requires the LLR distributions /a(^) and /a|c(C|c), which in 
general are unknown. We thus address on-the-fly estimation of 
the quantization parameters. The boundaries can be estimated 
by using an empirical estimate of the unconditional LLR 
distribution F\{(,), which can be obtained from a reasonable 
number of non-quantized LLRs. 

In contrast, determining the quantization levels AJ|; by 
estimating /a|c(C|c) is more difficult since the code bits 
are unknown at the receiver Hence, we propose to use the 
following simple parametric model, which is motivated by 
numerical results for the 2x2 case with 16-QAM (other system 
parameters may require a different model): 

To estimate the two parameters a > and /9 > 0, we choose 
two bins Ti and T2 and use the non-quantized LLRs A to 
obtain empirical estimates Pi, i ~ 1,2, of the probabilities 

P) = Pr{A = J_ hiO , 

with /a(0 = [/a|c(^|c = 0) + /a|c(^|c= l)]/2. The system 
of equations Pi{a,f3) = Pi can then be solved numerically 
to obtain estimates of a and /3. The transition probabilities 
of the equivalent channel and the quantization levels are then 
computed based on (10) using the estimates of a and f3. 

VII. Numerical BER Results 

To verify the capacity results, we performed BER simula- 
tions for SISO- and MIMO-BICM systems in ergodic Rayleigh 
fast fading. The channel code was a regular LDPC code^ with 
rate 1/2 and block length 64000. 

^The LDPC code was designed using the EPFL web-tool at 

http : / /Ithcwww . epf 1 . ch/research/ldpcopt. 
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Fig. 7. BER performance for a rate- 1/2 LDPC coded SISO-BICM system 
with BPSK and different LLR quantization word-lengtlis. 
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Fig. 8. BER performance for a rate- 1/2 LDPC coded 2x2 MIMO system 
with Gray-labeled 16-QAM and different LLR quantization word-lengths. 



A. SISO-BICM 

We first consider a BPSK-modulated SISO-BICM system 
with LLR quantizers designed using the analytical results 
from Section IV. Fig. 7 shows the BER for our proposed 
LLR quantizers with different word-length together with the 
theoretical SNR thresholds (obtained from Fig. 2). All BER 
curves are reasonably close to the respective SNR thresholds 
(obtained from Fig. 2 and indicated by vertical lines). The gaps 
of 1-bit, 2-bit, and 3-bit LLR quantization to the non-quantized 
case respectively equal 6.2 dB, 1.1 dB, and 0.4 dB. 

B. MIMO-BICM 

Fig. 8 shows two (strongly overlapping) sets of BER curves 
for the 2x2 MIMO-BICM system with Gray-labeled 16- 
QAM and different LLR quantization word-lengths. One set of 
curves (labeled 'offl.') pertains to an offline design of the LLR 
quantizer, whereas the other set (labeled 'onl.') estimates the 
quantization parameters on-the-fly according to Section VI. 

The gap to the theoretical SNR thresholds (obtained from 
Fig. 4 and indicated by vertical lines) equals 0.6 dB for 3-bit 
and 2-bit quantization and 1 dB for 1-bit quantization (hard 
demodulation). Furthermore, the proposed on-the-fly estimator 
for the LLR quantizer parameters performs extremely well in 
this setup (virtually indistinguishable from the offline design). 

To illustrate the importance of the correct choice of the LLR 
quantization levels. Fig. 9 shows BER versus quantization 
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Fig. 9. BER versus quantization level for 1-bit quantization at an SNR of 
12.8 dB using a rate-1/2 LDPC code (2x2 MIMO, 16-QAM, Gray labeling). 

level A2 = — Ai for the same MIMO system as before with 1- 
bit LLR quantization at an SNR of 12.8 dB. Here, the optimal 
quantizer level = 2.26 (indicated by a dashed vertical line) 
achieves a BER of 4.5 • 10~^. It is seen that the BER achieved 
by the belief propagation decoder is quite sensitive to the 
choice of A2; for A2 < 1.5 or A2 > 4.3, BER has deteriorated 
to about 10~^ (i.e., by more than 2 orders of magnitude). 

VIII. Conclusion 
We considered bit-interleaved coded modulation systems 
with demodulators providing quantized log-likelihood ratios 
(LLR). We provided design rules which lead to easily imple- 
mentable LLR quantizers and studied the information rates 
of the equivalent discrete channel in the ergodic and outage 
regime. Numerical results for capacity and bit error rate 
showed that LLR quantization using a small number of bits 
is often sufficient. We also proposed simple procedures to 
estimate the quantizer parameters during data transmission. 
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